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that compress well under a lossy compression tech- 
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be compressed losslessly are placed on another plane 
(14). Lossy compression is then applied to the lossy pix- 
el plane while lossless compression is applied to the 
lossless pixel plane. 
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Description 

[0001] This invention relates generally to image processing and, more particularly, to techniques for compressing 
the digital representation of a color document. 

s [0002] Documents scanned at high resolutions require very large amounts of storage space. Instead of being stored 
as is, the data is typically subjected to some form of data compression in order to reduce its volume, and thereby avoid 
the high costs associated with storing it. "Lossless" compression methods such as Lempel-Ziv (LZ) do not perform 
particularly well on scanned pixel maps. While "lossy" methods such as JPEG work fairly well on continuous-tone pixel 
maps, they do not work particularly well on the parts of the page containing text. To optimize image data compression, 

10 techniques, which can recognize the type of data being compressed, are needed. 

[0003] In accordance with one aspect of the present invention, a method of processing digital image data that is 
composed of multiple superimposed separations comprises: 

a) dividing the image data into separations, wherein each separation is composed of light intensity signals in 
is discrete locations, each of said light intensity signals having a value which indicates a magnitude of a light intensity 

of the image data in said separation at said discrete location; 

b) partitioning each separation by creating a lossless signal plane and a lossy signal plane; 

c) generating a selector map which indicates, for each discrete location in each of said separations, whether light 
intensity signals previously located thereon have been placed on said lossless signal plane or on said lossy signal 

20 plane; and 

d) separately compressing said lossless signal planes and said lossy signal planes in a manner best suited for 
compressing a type of data contained thereon. 

[0004] In accordance with another aspect of the present invention, an apparatus for processing digital image data 
25 that is composed of multiple superimposed separations comprises: 

a) means for dividing the image data into separations, wherein each separation is composed of light intensity 
signals in discrete locations, each of said light intensity signals having a value which indicates a magnitude of a 
light intensity of the image data in said separation at said discrete location; 
30 b) means for partitioning each separation by creating a lossless signal plane and a lossy signal plane; 

c) means for generating a selector map which indicates, for each discrete location in each of said separations, 
whether light intensity signals previously located thereon have been placed on said lossless signal plane or on 
said lossy signal plane; and 

d) means for separately compressing said lossless signal planes and said lossy signal planes in a manner best 
35 suited for compressing a type of data contained thereon. 

[0005] The present invention is directed to segmenting and then compressing color image data, for example using 
the MRC format. The segmenting embodiments of the invention are directed to separating the original image data into 
two planes based upon the manner in which the data should subsequently be compressed. Compression embodiments 

40 are directed to compressing the data on the segmented planes using an appropriate technique. The compressed planes 
are then combined to produce the final output image. The compression technique will either have one selector plane 
for the entire image (image-wise segmentation), or one per separation (separation-wise segmentation). 
[0006] In one embodiment of the invention, a method of compressing a pixel map representation of a document is 
disclosed, the method including the steps of: creating a first image plane from the pixel map representation of a doc- 

45 ument, the first image plane containing color signals for a first subset of image data in the document; creating a second 
image plane from the pixel map representation of the document, the second image plane containing image signals for 
a second subset of image data in the document; creating a selector plane from the pixel map representation of the 
document, wherein the selector plane selects between the first subset signals and the second subset signals when 
decompressing the compressed pixel map representation of the document; and pre-processing the first image plane 

50 and the second image plane based upon data contained in the selector map. 

[0007] In another embodiment of the invention an apparatus for processing pixel map representations of documents 
is disclosed, including: means for creating a first image plane from the pixel map representation of a document, the 
first image plane containing color signals for a first subset of image data in the document; means for creating a second 
image plane from the pixel map representation of the document, the second image plane containing image signals for 

55 a second subset of image data in the document; means for creating a selector plane from the pixel map representation 
of the document, wherein the selector plane selects between the first subset signals and the second subset signals 
when decompressing the compressed pixel map representation of the document; and means for pre-processing the 
first image plane and the second image plane based upon data contained in the selector map. 
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[0008] In yet another embodiment of the invention, a program storage device tangibly embodying a program of in- 
structions executable by a machine to perform method steps for compressing a document image is disclosed, wherein 
the method steps include: creating a first image plane from the pixel map representation of a document, the first image 
plane containing color signals for a first subset of image data in the document; creating a second image plane from 

s the pixel map representation of the document, the second image plane containing image signals for a second subset 
of image data in the document; creating a selector plane from the pixel map representation of the document, wherein 
the selector plane selects between the first subset signals and the second subset signals when decompressing the 
compressed pixel map representation of the document; and pre-processing the first image plane and the second image 
plane based upon data contained in the selector map. 

70 [0009] An example of a method and apparatus according to the invention will now be described with reference to 
the accompanying drawings, in which: 

Figure 1 illustrates an example of the manner in which a composite image may be decomposed into three MRC 
image planes; 

is Figure 2 contains a schematic illustration of a document with multiple superimposed separations and the manner 

in which the separations may be individually represented; 

Figure 3 depicts a single separation after image data thereon has been separated into two planes; 

Figure 4 contains a flow chart with a general description of image processing according to an example of the 

present invention; 

20 Figure 5 illustrates a pixel map and the way in which data may be separated based upon constraints of subsequent 

compression; and, 

Figure 6 contains a detailed illustration of one embodiment of segmentation according to the present invention. 

[0010] The present invention is directed to a method and apparatus for separately processing the various types of 
25 data contained in a composite imago. While the invention will described in a Mixed Raster Content (MRC) technique, 
those skilled in the art will recognize that it may be adapted for use with other methods and apparatus' and the invention 
is therefore, not limited to this description. The technique described herein is suitable for use in various devices required 
for storing or transmitting color documents such as facsimile devices, image storage devices and the like. While 
processing of color documents is preferred, it should be noted that similar image processing concepts apply to grayscale 
30 black and white documents and as a result, those portions of the invention that are described with reference to color 
documents may be similarly applied to gray scale documents. 

[001 1] Color images are typically described as being divided into "separations." Color output devices such as printers 
and computer monitors typically output data using only a few independent color sources. Colorants or color signals 
obtained from these sources are then blended together in appropriate ways in order to produce the full gamut of colors 

35 that may be represented using the device. In a device dependent printer color space, Cyan, Magenta, Yellow and black 
are the individual colorants that are most often used in color printers. These colorant separations are typically labeled 
C, M, Y and K. Many device-independent color spaces also exist, such as CIE L*a*b*, in which the separations are 
Lightness, labeled L*, relative amount of red vs. green, labeled a*, and relative amount of yellow vs. blue, labeled b*. 
[001 2] A pixel map is one in which each discrete location on the page contains a picture element or "pixel" that emits 

40 a light signal with a value that indicates the color or, in the case of gray scale documents, how light or dark the image 
is at that location. As those skilled in the art will appreciate, most pixel maps have values that are taken from a set of 
discrete integers. For example, in a pixel map for a color document, individual separations are often represented as 
digital values, often in the range 0 to 255, where 0 represents no colorant (i.e. when CMYK separations are used) , or 
the lowest value in the range when luminance-chrominance separations are used. 

45 [0013] In an L*a*b* luminance-chrominance color space aO L* value means that no light is present (i.e. the location 
is completely black) , while a* =0 means no red or green is present and b* =0 means that the spot is neither blue nor 
yellow. Both a*=0 and b*=0 means that the spot is gray, (somewhere between black and white). When represented in 
an integer space, L*. a*, and b* are typically scaled and translated to fit the range of representable values. In this case 
a*=b* = 0 is actually represented with these values at the midpoint of their ranges, while a*=0 is used to represent 

50 green, and b*=0 is used to represent blue. 

[0014] Consequently 255 represents the maximum amount of colorant (for CMYK) or the highest value in the range 
(maximum light/white, red and yellow respectively for L*a*b*). In a gray-scale pixel map this typically translates to pixel 
values which range from 0, for black, to 255, for the whitest tone possible. The pixel maps of concern in the currently 
preferred embodiment of the present invention are representations of rasterized or "RlPped" images. That is, images 

55 which are created using a Raster Image Processor (RIP) to convert an electronic document, typically represented by 
a page description language such as PostScript, into a raster image. The present invention may also apply to repre- 
sentations of 'scanned 0 images - images that are created by digitizing light reflected off of physical media using a 
digital scanner. The term bitmap is used to mean a binary pixel map in which pixels can take one of two values, 1 or 0. 
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[0015] Turning now to the drawings for a more detailed description of the MRC format, pixel map 10 representing a 
color or gray-scale document is preferably decomposed into a three plane page format as indicated in Figure 1. The 
document format is typically comprised of an upper plane 12, a lower plane 14, and a selector plane 16. Upper plane 
12 and lower plane 14 contain pixels that describe the original image data. Pixels in the original image are separated 
5 based upon pre-defined criteria such that some of them are placed on upper plane 12 and the rest on lower plane 14. 
Selector plane 16 keeps track of every pixel in original pixel map 10 and maps all pixels to an exact spot on either 
upper plane 12 or lower plane 14. 

[0016] The upper and lower planes are typically stored at the same bit depth and number of colors as the original 
pixel map 10, but possibly at reduced resolution. Selector plane 16 is created and stored as a bitmap. It is important 
io to recognize that while the terms "upper" and "lower" are used to describe the planes on which data resides, it is not 
intended to limit the invention to any particular arrangement or configuration. Further, it is also possible to practice the 
invention with a configuration that results in both planes being placed such that neither is actually on the top or bottom 
(i.e. side by side). 

[001 7] After processing, all three planes are compressed using a method suitable for the type of data residing therein. 

75 For example, upper plane 1 2 and lower plane 1 4 may be compressed and stored using a lossy compression technique 
such as JPEG or a lossless compression technique such as Lempel-Ziv (i.e. gzip) or CCITT-G4. Selector plane 16 
may be compressed and stored using a lossless compression format. It would be apparent to one of skill in the art to 
compress and store the planes using other formats that are suitable for the intended use of the color document. For 
example, in the Color Facsimile arena, group 4 (MMR) would preferably be used for selector plane 16, since the 

20 particular compression format used must be one of the approved formats (MMR, MR, MH, JPEG, JBIG, etc.) for fac- 
simile data transmission. 

[0018] Turning now to Figure 2, in the present invention digital image data is processed during a MRC technique 
such as described above. A color pixel map 10 is composed of multiple superimposed separations, where each indi- 
vidual separation distributes spectral power for a different wavelength range of light in the digital image. In one em- 

25 bodiment of the invention, these individual separations supply cyan 102, magenta 104, yellow 106 and black 108 
colorants in a hardcopy output printing device. While the invention will hereinafter be described with reference to a 
scheme in which a printer provides these four colorants, those skilled in the art will recognize that other embodiments 
are possible. For example in another embodiment, individual separations emit red, green and blue colored light signals 
from phosphors in a video monitor. In still another embodiment, colorants are supplied in a hardcopy output printing 

30 device in a manner that is dependent upon signals that represent luminance and relative amounts of red vs. green and 
yellow vs. blue. Further, while the invention is described here using four colorant separations, those skilled in the art 
will recognize that the number of separations in which pixel map 10 will be divided may be varied, depending upon the 
constraints of the device. It is intended to embrace all such alternatives and others that would be recognized as equiv- 
alent or easily adaptable by those of ordinary skill in the art. 

35 [001 9] The present invention first requires dividing the superimposed separations into individual colorant separations 
102, 104, 106 and 108. For purposes of illustration, horizontal, vertical, and diagonal lines represent the wavelength 
ranges (colors) for each separation. Since pixel map 10 preferably represents a scanned image, the image, and there- 
fore each separation 102-108 contained therein, is composed of light intensity signals dispersed throughout the sep- 
aration at discrete locations. Again, a light signal is emitted from each of these discrete locations, referred to as "picture 

40 elements," "pixels" or "pels," at an intensity level which indicates the magnitude of the light that being reflected from 
the original image at the corresponding location in that separation. 

[0020] Referring now to Figure 3, the invention will hereinafter be described with reference to processing cyan col- 
orant separation 1 02. The process is identical for separations 1 04-1 08, and the description applies to those separations 
as well. In typical MRC fashion, separation 102 is partitioned into two planes. In the present invention, the criteria for 

45 deciding on which plane a pixel will be placed is the manner in which the pixel will best be compressed. Thus, separation 
102 is divided into two planes-one lossless 222 and one lossy 224. More specifically, pixels in each separation are 
classified as either "lossy" or "lossless," based upon the type of compression that should be applied. Those signals 
that for a given level of quality will compress at a higher compression ratio losslessly are referred to as "lossless", while 
the remaining pixels are referred to as "lossy". 

so [0021] Generally speaking, lossy compression is a process that substantially reduces the volume of remaining data. 
Because of its ability to reduce data, it is desirable to apply a lossy compression technique whenever possible. Unfor- 
tunately producing such large amounts of data reduction also means that large amounts of imaging information will be 
lost. This often means that imaging accuracy will be significantly reduced. Pictorial data is one type of data that typically 
survives lossy compression well. 

55 [0022] Text and large areas of a page covered with signals at a single light intensity are types of data that typically 
compress better losslessly. Areas containing strong edges - sharp discontinuities between regions of two constant 
colors-require very low compression ratios to provide acceptable image quality when compressed lossily. Areas con- 
taining only constant colors - no edges whatsoever - or only smooth gradations, compress very well using either tech- 
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nique, providing maxima! compression ratios with no artifacts. The highest achievable compression ratios with lossless 
compression are generally higher than with lossy techniques, so in order to exploit the high compression available in 
these regions, lossless compression is preferred. 

[0023] Lossy signal plane 222 is the location designated for pixels that have been classified as lossy. The remaining 
s pixels are designated for lossless signal plane 224. Looking at separation 102, in other words lossy plane 222 will 
contain pixels for which it has been determined that lossy compression would be acceptable and desirable. The re- 
maining pixels will be placed on lossless plane 224. Pixels that are placed on lossy plane 222 are placed in a location 
on plane 222 that directly corresponds to that in which they resided in separation 102. The remaining pixels are then 
placed on plane 224 in sequential order moving from right to left and from top to bottom. 
10 [0024] Figure 4 contains a flow chart indicating the sequential order of the steps that are followed in one embodiment 
of the invention. The process begins by dividing original pixel map 1 0 into it individual separations 1 02 - 1 08, as indicated 
in step 310. Each separation is then partitioned into two planes as shown in step 320. As described above, these two 
planes are a plane 222 that will contain the pixels that are best compressed losslessly and a plane 224 that contains 
pixels that should be compressed lossily. A selector plane 16 is also generated as indicated in step 330, to keep track 
is of the location of each pixel as original plane map 10 is partitioned. The planes are then compressed independently 
as indicated in steps 340 and 350. 

[0025] The steps of Figure 4 will usually be performed by a suitably programmed computer although corresponding 
hardware embodiments will be readily envisaged by a person of ordinary skill in the art. 

[0026] Turning now to Figure 5, assume that the contents of original pixel map 10 are as shown in block 402, and 
20 that image data indicated by characters a, c, f, i, j, k, m and p will adequately survive lossy compression. Under these 
circumstances, that data will be placed in lossy plane map 222 as shown in the illustration. The remaining characters 
b, d, e, g, h, I, n and o are then placed on plane 224. 

[0027] Still referring to Figure 5, partitioning of separation 102 is performed by generating a selector plane 16 which 
maps, for each location in the separation, whether the pixel residing there has been placed on lossy plane 222 or on 

2S lossless plane 224. Binary values are placed on selector piano 16 to provide this indication. As shown, 0's are placed 
in selector plane 16 in locations where pixels have been designated for lossless plane 224, while 1 's are in the locations 
where signals have been placed on lossy plane 222. Once the planes have been created, they are compressed using 
an appropriate lossy or lossless compression technique. In the preferred embodiment of the invention, JPEG's ADCT 
compression will be applied to lossy plane 222, while freeware "gzip" will be applied to lossless plane 224. See G. 

30 Wallace 'The JPEG still picture compression standard", Communications of the ACM 34 (4), pp. 30-44, April 1991, the 
contents of which are hereby incorporated by reference, for a discussion of Adaptive Discrete Cosine Transform com- 
pression, also known as JPEG. 

[0028] It should be noted that an indication of the type of data in a section of the image could be obtained by deter- 
mining the number of consecutive pixels that have the same light intensity value. Short pixel runs - few consecutive 

35 pixels with the same light intensity - typically indicate that pictorial data is being processed. As stated earlier, pictorial 
data survives well when subjected to lossy compression. Thus, when only a few consecutive pixels have the same 
value or if the light intensity value is constantly changing, the pixels being processed are designated for lossy plane 
222. This obviously means that long pixel runs - several consecutive pixels with the same light intensity value - remain 
and will be placed on lossless plane 224. Again, this is generally acceptable because long pixel runs generally compress 

40 well when compressed losslessly 

[0029] Referring now to Figure 6, a detailed description of the preferred embodiment of the segmentation portion of 
the present invention will now be provided. First, the number of consecutive pixels within the separation for which the 
light intensity values are equal must be determined. Here it is sufficient that the light intensity values be nearly equal, 
that is equal to within some predetermined precision. It is known that high contrast data - data that has a light intensity 

45 value above a certain high threshold or below a certain low threshold - tends to exhibit artifacts when it is subjected to 
lossy compression (except in large regions of constant high or low value, where as previously indicated already indi- 
cated, lossless compression provides a higher compression ratio). When a short run has been identified the pixels in 
the run are designated in selector plane 16 as lossy pixels to be placed on lossy plane 222 as long as they are not 
high or low contrast pixels. The remaining pixels - high or low contrast or part of a long run - are classified as lossless 

50 pixels to be placed on lossless plane 224. 

[0030] In one embodiment of the invention, data that is nearly constant for a run is modified so that the entire run is 
changed to the average value, and then compressed losslessly. In this way, scanned data of a constant value has 
scanning noise removed before the decision is made whether to compress lossily or losslessly. In long runs of data in 
which the light intensity values are slowly increasing or decreasing, similar smoothing may be performed, but only in 

55 such a way as to preserve the gradual increase or decrease in values. 

[0031] As indicated in the illustration, pixels in the lossless plane are not arranged in the same manner as those in 
lossy plane 222. Pixels in lossless plane 224 are deposited onto the plane in serial fashion such that they are processed 
in the same order that they would be if they remained on separation plane 102. 
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[0032] A long pixel run is typically one that has at least somewhere between four and eight pixels in a row with the 
same light intensity value. In one embodiment of the invention, the Cyan separation of an image produced using color 
xerographic toner particles was compressed using a run length of 6 pixels, a high contrast value of 255 and a low 
contrast value of 0. These parameters resulted in a compression ratio of 1 0 to 1 . Run length and contrast parameters 
can be varied in order to influence the amount of data that will be sent to lossy plane 222 instead of lossless plane 224. 
[0033] Once segmentation has been completed, selector plane 16 is used to compress the data on both lossy plane 
222 and lossless plane 224. Looking first at lossy plane 222, lossy data is typically block oriented. Generally speaking, 
lossy compression is performed by processing data in blocks-entire groups of pixels are processed simultaneously. 
Empty spaces on plane 222, which correspond to locations where pixels have not been retained, may be replaced by 
any value before compression occurs. The present invention takes advantage of the fact that non-retained values are 
not needed after compression by filling these spaces with pixel values that will result in high lossy compression effi- 
ciency. 

[0034] Turning back to Figure 5, in one embodiment of the invention, spaces on lossy plane 222 are filled in with 
pixel values that are equal to the previous neighbor in raster-scan order sequence. In another embodiment of the 
invention, these spaces are filled in by interpolating the pixels that were originally located in pixel map 10 in spots that 
correspond to the blank spaces using the DCT interpolation kernel. That is, each blank space is replaced with a pixel 
that has a value predicted by a DCT based interpolant. The lossy pixels in the block are fit with a number of terms in 
the expansion of the discrete cosine transform, the number being up to but not greater than the number of lossy pixels 
remaining. Given these terms, the interpolant is evaluated at the locations corresponding to the missing-pixels. In-this 
way, no new information is introduced into the block, which must be subsequently encoded using the DCT transform. 
[0035] When the final image is reconstructed (as part of decompression), the image will be formed using the inverse 
discrete cosine transform (assuming JPEG compression). That is, the pixel at location (x, y) in the block will be computed 
as 



;|IIC(«)C(v)F(«,v) x cos (^S^)cos(^n^)l , 

^* Lu-0v=0 J 

where 

C(0) = 1/V2, C(£ > 0) = 1 , and F(u,v) represents the transformed value at location (u , v). Each product B u v (x,)/) = C 
(u)C(v)cos(&x±^)cos(&^^ is a single basis function, and the pixel is constructed as a sum of scaled basis func- 
tions, where the scales are given by the transformed values. In a block with no "missing" pixels, the transformed values 
are uniquely specified as the only values which when inverse transformed, will give the original values. These are 
readily computed using the forward discrete cosine transform, which is similar in form to the inverse discrete cosine 
transform. In a block with missing pixels, the 64 transformed values to be multiplied by the basis functions represent 
more degrees of freedom than there are constraints. Specifically, if even one value is missing, there are infinitely many 
possible combinations of transformed values that will, when inverse transformed, give the correct values at the remain- 
ing pixels, while each combination will give a different value at the missing pixel. 

[0036] In large part JPEG compression derives its high compression ratio from the presence of small, insignificant 
values in the transformed block. In particular, high frequency values (i.e. values at locations for which u+v is large) are 
quantized in such a way that if they are small to begin with, they become 0 (this is the main origin of the loss in this 
form of lossy compression). One may think of the missing pixels as extra degrees of freedom, or one may think in 
terms of the extra degrees of freedom as being coefficients in the transformed domain. To improve compression, the 
objective is to use those extra degrees of freedom to maximize the compression ratio. This is achieved by arranging 
to have any extra transformed values 0. 

[0037] Given that JPEG provides the best compression if the high frequency terms are zero, and that if there are n 
pixels remaining in a block, there are only n frequency terms fully specified, the question is which n frequency terms 
should be used. One convenient choice is to use every basis function in order of increasing u+v, and where multiple 
values of u,v give the same u+v, use increasing v for odd u+v, and increasing u for even u+v (this is the well-known 
zig-zag order in the JPEG standard). 

[0038] Given a set of basis functions, B = {B u v (x : y), (u,v) DSJ, for some set S of pairs (u,v), the problem is to find a 
set of weights, which when used to form a weighted sum of the basis functions, will give values for the pixels that 
remain on the plane. Then the missing pixels will be computed by substituting their locations into the same weighted 
sums. In this way when the transform is computed during the actual compression step, high order terms will be zero, 
and low order terms will, upon being inverse transformed, yield the original, values for the pixels that remain on the 
plane. The missing values will be wrong, but they will subsequently be replaced by values from the lossless channel. 
[0039] To solve the problem of finding the set of weights, note that the locations of the remaining pixels forms a set 
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P of ordered pairs (x,y). Now number the elements of P in any convenient order, so that an element of P is simply pj. 
Similarly number the ordered pairs in S, so that an element of S is Sj. If the basis functions corresponding to elements 
of S are evaluated at locations corresponding to elements of P, and indexed accordingly, then the value at point p, is 
given by: 

s 

Z B u .Ax,yyO<, v) =£ B, (p,)F(.v- ) = £ B V F, 

J J I 

10 

[0040] Numbering the original "non-missing" pixels according to the index of their location, we have the constraint 

15 j 

with f, F vectors and B a matrix. This is a standard form : which may be solved exactly if the number of non-missing 

pixels is the same as the number of basis functions, or using standard least squares techniques otherwise. 

[0041] One special case is worthy of note; if only the lowest order basis function is used in the least-squares solution, 

20 the solution will guarantee that the DC term is the same as the average of the non-missing pixels. A more efficient way 
of achieving the same end is to simply set all of the missing pixels to the average of the remaining pixels. 
[0042] With continued reference to Figure 5, the values retained for lossy plane 222 are those which were marked 
with Vs on selector plane 16. As shown in the illustration, pixels must be placed in the lossy plane in locations that 
directly correspond to locations in which they were located on original pixel map 10. This leaves empty spaces distrib- 

25 uted throughout lossy piano 222 in the places that are marked by 0's on selector plane 16. The 0 values in selector 
plane 16 are useless as far as compression of lossy plane 222 is concerned since the losslessly compressed pixels 
on plane 224 will actually be placed in the final output image. As a result, these empty spaces can be filled with values 
that will best facilitate the lossy compression that will subsequently be applied. 

[0043] Still referring to Figure 5, processing of lossless plane 224 is similar in that values that have been marked 
30 with 0's are retained, since those are the ones designated as lossless pixels in selector plane 1 6. But unlike lossy data, 
lossless compression is generally performed on a pixel by pixel basis. Depending upon the constraints of the lossless 
compression method, the empty spaces on lossless plane 224 can also be filled with pixels that will enable maximum 
compression efficiency. In some cases, the empty spaces can simply be deleted. While lossless plane 224 is described 
as a "plane," it can actually be viewed as a continuous string of data. 
35 [0044] In one embodiment of the invention, these empty spaces will be replaced with pixel values that are equal to 
the previous neighbor in the ordinary raster-scan order sequence. In another embodiment ol the invention, each empty 
space will be filled with a pixel value equal to the most common pixel value that has been processed before it. If the 
empty spaces are deleted, their locations will be determined using selector plane 16. This means that pixels on lossless 
plane 224 do not have to be placed in locations that are in direct physical correspondence with those in original pixel 
40 map 1 0. The only criteria for locations in which pixels must be placed on lossless plane 224 is that they must be ordered 
such that they can be selected using selector plane 16 when necessary. Spaces filled on lossless plane 224 can be 
filled in with pixels that have values that have been manipulated or altered in the manner that will be most helpful during 
lossless compression. 

[0045] As described above, segmentation and compression are performed separation by separation. In another 
45 embodiment of the invention, segmentation and compression may be performed on all separations of the entire image. 
Under these circumstances, the criteria for distinguishing long pixel runs from short pixel runs involve all separations 
together. All separations must be constant for some number of pixels in a row for a run to be long. In addition, whether 
a pixel is "high contrast" or "low contrast" requires that all separations satisfy the same rule. Other than these require- 
ments, the steps in performing the method remain as described above. In the case of L*a*b* or a similar -luminance- 
50 chrominance based color space, it is also possible to perform the segmentation based on only the L* (lightness) sep- 
aration, and allow the a* and b* separations to be segmented in whatever way the L* dictates. Any errors caused by 
this approximation will come in the form of a* and b* data that is erroneously compressed lossily, which is unlikely to 
be scon, due to the eye's poor response to chromatic edges. Chrominance data that is losslessly compressed because 
of this approximation will not exhibit any errors, it will only not compress with quite as high a compression ration. 
55 [0046] Turning back to Figure 2, once each of the respective planes is generated, they are each compressed using 
a suitable compression technique, step 112. In the currently preferred embodiment, lower plane 14 and lower plane 
14 are compressed using JPEG while the selector plane 16 is compressed using a two-dimensional technique such 
as CCITT Group IV or a method of classifying scanned symbols into equivalence classes such as that described in 
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US-A 5,778,095 to Davies issued July 7, 1998, the contents of which are hereby incorporated by reference. 
[0047] In summary, the present invention uses the selector plane to replace, for each plane, pixels that have been 
designated to be provided by the other plane by carefully chosen values. The previously existing data is completely 
ignored, and the newly chosen values are calculated for such that the number of bits that will be generated during the 
5 subsequent compression is minimized. 

Claims 

io 1. A method of processing digital image data that is composed of multiple superimposed separations, comprising: 

e) dividing the image data into separations (102-108), wherein each separation is composed of light intensity 
signals in discrete locations, each of said light intensity signals having a value which indicates a magnitude 
of a light intensity of the image data in said separation at said discrete location; 
75 0 partitioning each separation by creating a lossless signal plane and a lossy signal plane (12,14); 

g) generating a selector map (16) which indicates, for each discrete location in each of said separations, 
whether light intensity signals previously located thereon have been placed on said lossless signal plane or 
on said lossy signal plane; and 

h) separately compressing said lossless signal planes and said lossy signal planes in a manner best suited 
20 for compressing a type of data contained thereon. 

2. A method of processing digital image data as claimed in claim 1, wherein for at least one separation, said lossy 
signal plane is composed of a lossy subset of light intensity signals placed in discrete locations that correspond 
to discrete locations in which said lossy light intensity signals resided in said separation, and wherein signals that 
are present on said lossy signal plane in locations that correspond to discrete locations in which said lossless light 
intensity signals resided in said separation are ignored. 

3. A method of processing an image as claimed in claim 2, wherein for at least one separation, said partitioning step 
further comprises: 

30 

a) counting a number of consecutive discrete locations in said separation for which said signals have equal 
light intensity magnitudes; 

b) designating said signals for said lossy subset when said counted number of consecutive signals is less than 
a pre-determined value; and 

55 c) placing signals not designated for said lossy subset in said lossless subset. 

4. A method of processing an image as claimed in claim 2, wherein for at least one separation, said partitioning step 
further comprises: 

40 a) placing signals not included in said lossy subset in said lossless subset; and 

b) for signals designated for said lossy subset, selecting signals that have magnitudes that are either greater 
than a high threshold value or less than a low threshold value, and moving said selected signals from said 
lossy subset to said lossless subset. 



25 



45 s. 



A method of processing an image as claimed in claim 2, wherein for at least one separation, said partitioning step 
further comprises in stated order, the steps of: 



a) counting a number of consecutive discrete locations in said separation for which said signals have light 
intensity magnitudes that lie within a pre-determined range; 
50 b) calculating an average value for said counted light intensity values; and 

c) replacing signals in each of said consecutive discrete locations with said calculated average light intensity 
value. 

6. An apparatus for processing digital image data that is composed of multiple superimposed separations, comprising: 

a) means for dividing the image data into separations (102-1 08), wherein each separation is composed of light 
intensity signals in discrete locations, each of said light intensity signals having a value which indicates a 
magnitude of a light intensity of the image data in said separation at said discrete location; 
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b) means for partitioning each separation by creating a lossless signal plane and a lossy signal plane (12 ? 14) ; 

c) means for generating a selector map (16) which indicates, for each discrete location in each of said sepa- 
rations, whether light intensity signals previously located thereon have been placed on said lossless signal 
plane or on said lossy signal plane; and 

5 d) means for separately compressing said lossless signal planes and said lossy signal planes in a manner 

best suited for compressing a type of data contained thereon. 

7. A programmable storage device readable by a machine, and embodying a program of instructions defining method 
steps for processing digital image data that is composed of multiple superimposed separations, the method steps 
10 comprising: 

a) dividing the image data into separations (102-108), wherein each separation is composed of light intensity 
signals in discrete locations, each of said light intensity signals having a value which indicates a magnitude 
of a light intensity of the image data in said separation at said discrete location; 
is b) partitioning each separation by creating a lossless signal plane and a lossy signal plane (12-14); 

c) generating a selector map (16) which indicates, for each discrete location in each of said separations, 
whether light intensity signals previously located thereon have been placed on said lossless signal plane or 
on said lossy signal plane; and 

d) separately compressing said lossless signal planes and said lossy signal planes in a manner best suited 
20 for compressing a type of data contained thereon. 



25 



30 



35 



40 



45 



SO 



55 



BNSOOCID: <EP 100671 5A2_I_> 



9 



EP 1 006 715 A2 




FIG. 7 
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